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Description 

TPrHNIHAL FIF 1 D QE ™ g INVENTION 

The invention relates to a technique, specifically apparatus and an accompanying method, tor accurately thresh^ 
otding an image based on local image properties, specifically luminance variations, and particularly one that uses multi- 
windowing for providing enhanced immunity to image noise and lessened boundary artifacts. 

RAPk^RnilND ART 

With digital image processing and digital communication becoming increasingly prevalent today, increasing amounts 
ot printed or other textual documents are being scanned tor subsequent computerized processing of one form or another 
and/or digital transmission. This processing may involve, tor example, optical character recognition, tor converting printed 
characters whether machine printed or handwritten, from scanned bit-mapped form into an appropriate character set, 
such as ASCII, the latter being more suitable for use with word processing and similar computerized document-prccess- 

^ t S!anning a grayscale document typically yields a multi-bit, typically eight-bit value for each pixel in the scanned 
document The value represents the luminance, in terms of a 256-level gray scale, of a pixel at a corresponding point 
in the document These pixels are generated, depending upon the resolution of the scanner, frequently at resolutions 
of 200 400 pixels/inch (approximately 80-160 pixels/cm), though with highly detailed images at upwards of 1200 or more 
oixete/inch (approximately 470 pixels/cm). Consequently, a scanned 8 1/2 by 11 inch (approximately 22 by 28 cm) image 
wit) contain a considerable amount of gray-scale data. Inasmuch scanned text generally presents a written or printed 
characters of some sort against a contrasting colored background, typically white or black print against a white or light 
colored background or vice versa, the exact luminance value at any one pixel in the text is not as important as whether 
that pixel is either part of a character or the background. Therefore, scanned textual images, or scanned textual portions 
of larger images containing both text and graphics, can be efficiently represented by single-bit pixels in whfch each pixel 
in a scanned image is simply set to. e.g.. a "one" rf that pixel in the original image is part of a character or part of 
toreoround information, or to. e.g.. a "zero* H that pixel in the original image is part of the image background. To easity 
distinouish the different types of scanned images, a gray-level image is defined as one having multi-bit (hence mutto- 
value) pixels whereas a binary (or bi-level) image is formed of single-bit pixels. Furthermore, since binary images gen- t 
erate considerably less data for a given textual image, such as. e.g.. one-eighth, as much as for an eight-bit grey-scate 
rendering of the same image, binary images are more efficient over corresponding gray-scale images and thus preferred 
for storage and communication of textual images. Binary images are also preferred because of their easy compresstoilrty 
using standard compression techniques. e.g.. CCITT Groups 3 w 4 . compression sta^ 

Gray-scale images are converted to binary images through a so-called thresholding process. In essence, each mufa- 
bH Dixel value in a gray-scale scanned image is compared to a pre-defined threshold value, which may be fixed, variabJe 
or even adaptively variable, to yield a single corresponding output bit. If the multi-bit pixel value equals or exceeds the 
threshold value tor that particular pixel, the resultant single-bit output pixel is set to a "one'; otherwise rf the threshold cs 
greater than the multi-bit pixel, then the resultant single-bit output pixel remains at "zero". In this manner, thresholding 
extracts those pixels, such as those which form characters, or other desired objects, from the background in a scanned 
orav-scale image with the pixels that form each character, or object, being one value, typically that tor black, and the 
pixels tor the background all being another value, typically that for white. For ease of reference, we will hereinafter 
collectively refer to each character or other desired object in the image as simply an "object". 

Ideally the best thresholding process is one which accurately selects all the object pixels, but nothing more, in the 
scanned irnage and maps those pixels to a common single-bit value, such as. e.g.. "one" for black. In practice, noise, 
background shading, lighting non-uniformities in a scanning process and other such phenomena, preclude the use of a 
single f ixed threshold for an entire image. In that regard, if the threshold is too low, the resulting image may contain an 
excessive amount of noise in certain. H not all regions; or. H too high, insufficient image detail, again in certain, H not aQ. 
regions - thereby complicating the subsequent processing of this image! Given this, the art recognizes that a preferred 
approach would be to select a different threshold value that is appropriate to each and every pixel in the scanned image. 
Indoing so the proper threshold value is determined based upon local properties of the image, i.e.. certain image 
characteristics that occur in a localized image region for that pixel. Hence, the threshold would vary across the image, 
possibly even adapt to changing localized image conditions. 

In general a common methodology for variable thresholding relies on measuring localized image characteristics, 
such as local intensity contrast (or gradient), local averaged intensity and/or local variance, in a local window centered 
about a pixel of interest and then using these measures to classify image pixels into either object pixels, black, or back- 
ground pixels white. Here, too, reality diverges from the ideal inasmuch this methodology is complicated, and often 
frustrated by a need to extract various objects in a wide range of documents but with minimal user intervention, such 
as for purposes of initialization and object identification, and while still yielding a clean background in the threshokJed 
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Nevertheless, given the overwhehning m ^^f^^'\^^ that attempt to provide satisfactory 
♦►Tari has persisted by teaching several variable thresholding aPP"? Dract ice. tend to limit their utility. 

P V^ouTapproaches. based upon measurements d dflere" Uocataed P ^ anri 

a,.. SSo^f Binary ^X£?hE S£ level' Voach is based on con^a 

7 ' oPrnressing , VOL 55. No. 3. May 1993. pages , 203>n 1our loca , averages m ne^hborhocds 

SJS^Ta^ven pixel or its smoothed gray evel (it the .mage ,s "°2 ay level ol the given pixel is suHicientiy below 

^ ,o ^nd^nedbythepresentassigneehereof)..el,esont 8 f "^^^signa,. Here, whenever a transition 

Wes^d^ecting low contrast objects ^ to j c . siom * e , on August 28 1 984). 

a Tether approach is described .n Unrted States Patent 4.46B, /u > • _ obtained on a pixel-by-pixel 

^ctiSU^ast objects in a thresholded image. appara ,us and an accompanying method, tor accu- 

T * Jetore. a need exists in the art lor a technique^ ^^ y ^f n ^ ing a threshold that varies based on local 

^22'th?Sw« a"™ 1 pi>e<(i j). m » "«" 2ed '"S^SS censed about potion (i j). 

graoierTB. das£ jfjed as being an object pixel, i.e.. oiac*. or « « ^ thr parameters are 

u^£arei^raS.6Sr..D 

SlitorUhandevery and Lma« va>ues. Once the grad.e* 
boththe gradient s^ 
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i i e v,n these local measures, each image pixelfl j) is first classified as being near an edge or not. In that regard, each 
• i oar an -doe is so classified if the local measures therefor, specifically its associated area gradient, exceeds a 
P L JZ J threshold value. Otherwise, that pixel is viewed as falling within a locally flat field, i.e.. of relatively constant 
pre-aeiineo unre ^ classHied by comparing their intensity values against average intensity values 

toTlolaTN-by^pixel windows therefor; in contrast, pixels in flat fields are classHied by comparing their intensity against 
a pre-determined intensity value. 

ir, M riiruiar an image pixel(i j) located in a vicinity of an edge in the image is detected whenever the area gradient. 
r* «a n w feat oixel is high, particularly being larger than a predefined gradient threshold. GT. Once such a pixel 6 
? S i J*rh oixel on a darker side of the edge is found. This latter pixel being in the center of a local N-by-N. e.g.. 7-by- 
Tn^ol wSjow is classHied as an object pixel, i.e.. black, whenever its intensity, is smaller than an average of its 
Stated lI and ^ values. Alternatively, it the intensity of this latter pixel. Lc, exceeds the average intensity value 
8 ff anriL™ then this particular pixel is classified as being background. i.e.. white 

tnTarea aradient. GSf. j). for pixel(ij) is less than the gradient threshold, such as where the N-by-N window 
i-H e 72f„no an imaoe region of relatively constant gray-scale, pixel(ij) is classified by simple thresholding, i.e.. thresh- 
,?^»r™ a v scale value against a constant predefined threshold value. IT. Here. H the gray-scale value of pixel(ij) is 
°ess7han S threshold value IT, this pixel is dassHied as an object pixel. Le.. black; otherwise, this pixel is designated 

85 P ?« ^hflnrJiSoe" edgeJand b^doing so further increase thresholding accuracy, the intensify values of those pixels 
°J TJttol Ze modified. For the preferred embodiment, black pixels are illustratively represented by a value of zero 
J ?«!X>i e bv a value off. Specifically, for those pixels located on a darker side of an edge and having an intensity 
B *^< £ctX to Zes>KM value. IT. the intensity of each of these pixels is reduced to a value slightly below 
£ ~h«S iTe a to a value IT-. In contrast, the intensity values for those pixels, located on a brighter side of an edge 
^ r2°Jinn in intensity value less than threshold value IT. are increased to an intensity value slightly greater than thresh- 
old va^u JTt e.g. to value IT*. A high qualHy binary image can then be produced by merely thresholding the resulting 
e/-ai« imaae aaainst pre-defined threshold value IT. 

2J! a rtaS)usly through the use of area (summed intensity) gradients, the present invention significantly reduces 
^V^nrr,T.rri noise and boundary artifact generation while accurately extracting objects in a threshotded image. The 
n^H^ray-scale image, when subsequently thresholded using a fixed threshold value IT. greatly enhances detection 
of low contrast objects and thus readily produces a high quality binary image 

pripp RESCRIP T'™ rip THE DRAWINGS 

The teachings of the present invention may be readily understood by considering the following detailed description 
in conjunction with the accompanying drawings, in which: 

FIG. 1 depicts a high-level block diagram of document imaging system 5 that embodies the teachings of our present 

invention; 

FIG. 2 depicts the correct alignment of the drawing sheets for FIGs. 2A and 2B; 

FIGs 2A and 2B collectively depict a high-level flowchart of our inventive multi-windowing thresholding method; 

FIG 3A depicts a 3-by-3 matrix of pixel location definitions which we use in determining, through a "Sober gradient 
operator, gradient strength for current pixel(i.j); 

FIG 3B depicts a graphical representation of an N-by-N neighborhood of pixels centered about a cunent pixelfij) 
in an image intensity record; 

FIG. 3C d€picts a graphical representation of an (N-2)-by-(N-2) neighborhood of pixels centered about pixel position 
(ij) in an image intensity gradient record; 

FIG 4 graphically depicts intensity profile 400 of an illustrative scan line of an original gray-scale image, such as 
that illustratively on document 1 0 shown in FIG. 1 ; 

FIG 5 graphically depicts a modified intensity profile which results after thresholding intensity profile 400 shown in 
FIG! 4 according to the teachings of our present invention; 

FIG 6 depicts a block diagram of a preferred embodiment of our present invention; 
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FIG. 7 depicts a block diagram of Sum of Gradients Circuit 620 which forms part of circuit 600 shown in FIG. 6; and 

FIG. 8 depicts a block diagram of 7-by-7 Maximum and Minimum Detector 635 which also forms part of circuit 600 
shown in FIG. 6. 

To facilitate understanding, identical reference numerals have been used, where possible, to denote identical ele- 
ments that are common to various figures. 

MQQES OF ^ Bav ^ Ol IT THE INVENTION 

A« e r readino the lollowing description, those skilled in the art will quickly realize that our invention is applicable tor 
use ^ neariy an? document imaging system tor accurately thresholding scanned documentary .mages contam.ng l.ne 
»n t^th regardless of what that line art contains and the media upon which the image ong.na.. y appears. For example. 
?he J!S3 5 graphs, maps, characters and/or line (skeletal) drawings. Nevertheless tor the purpose of ■"pi** 
2 Sow^o^sstoa we wHidiscuss our invention in the context of use in thresholding scanned character data, such 
Z textual letters and numbers, which we will collectively refer to hereinafter as -objects-. . ^ _ 

T^oumoses of illustration and discussion, we define black and white gray-scale p.xels as havrng eight-brt gray- 
, n f ue ot-0- and -255". respectively. For consistency, we also define output binary pixels wHh black be.no "0; and 
"Sf^-r Clea^y our inventive meLd will tonri^^ 

that centre pixel intensities, as would be readily apparent to those skilled in the art. reversed from those 

Eh T^d d ep 6 ict?fhigh-.ev e l block diagram of document imaging system 5 that embodies the teachings of our present 
irJrSn As shown system 5 is formed of gray-scale scanner 20. digital image processor 30 and "simple tfuesho!d,ng 
^3 40 ^coe^on document 10 containing various objects of interest is scanned by scanner 20 to produce mu»b- 
STS^SSSS W-mapped grayscale image data. L This data is routed, viands 25. to a data .nputot d.g^ 
^oTocesS whfch. in turn and to the extent relevant here, thresholds the scanned image data and generates both 
L^H^araTscale image on leads 37 and an output binary image on leads 33. The modrf ,ed gray-scale .mage, as 
! iSS^M detail below, has its edges enhanced by processor 30 to subsequently increase thresholding accu- 

^SJ^I^ d*^ on ,eads 37 fe rouled t0 a " lnpUt 01 tn ' esno,din9 drCuit 40 Whieh - 
co^i^ ^ bit "age pixel in themodif^ image data against a predefined MtaM value thereby 

jSled^simple- thresholding. The resulting threshokJed. i.e.. binary, image produced by crcurt 40 rs apphed. 

1st %JE*£« binary image. Digital iLge processor 30 penorms thresholding In accordance wHh our 
nfeSJtrie'n^ To handle high data throughputs required for processing bit-mapped .mages pressor 30 rs prefer- 
^abrSted from ^dedicated hardware circuitry, induding our inventive circuit 600 shown .n FIG. 6 and drscussed in 
! /• S^ematively this processor can be implemented through one or more general purpose m.croprocessors. 

is^teS men»o ^nd supporting circuitry and suitably programmed to implement our^esent invention in scM- 
^ ^SSZZemaopZess^s) could execute instructions sufficiently fast to produce the reqinsrte data 

thr °?K'level flowchart of our inventive multi-windowing thresholding method 200 is collectively depicted in FKSs. 2A 
and 2B tor wrJch^correct alignment of the drawing sheets tor these figures is shown in FIG. 2. During the course of 
Hi^riissino method 200. reference will also be made to FKSs. 3A-3C where appropriate. 
TiSte performed for each and every grayscale pixel in an incoming image, thereby rteratng ttrough the 
•mJTs^nce Z manner through which each gray-scale image pixel is processed is kJentical across all such p«els. we 
wZeSv dlscusTmis routine in the context of processing generated pixel<ij). where i and j are posn,ve .ntegers and 
and vertical indices within the incoming grayscale image. In addition tograyscale .mage date. 
» 1Z sullies vies of two input parameters. specif ica.ly fixed thresholds IT andGT. These thresholds are adjusted. 

r r^S below eHher to provide satisfactory thresholding across a multitude of differing .mages w,th vary.ng char- 
acteStStucS^ ccSf a'nd illuminate, or'can be adjusted to provide optimum threshing for any one type of 
rlnfaS/o^ Scanning condition. In any event, as a result of performing method 200 on all such grayscale '™9epucels. 
ITesboldtd My or modHied grayscale image will be generated, with each pixel in the resulting .mage corresponding 

Z ?maa X men^hresholded in a "simple" fashion using a fixed, pre-defined threshold, havrng a value IT. as M value 
^eSbJci The modHied grayscale image can then be further processed. e.g.. through scalmg or f .ttenng. as 



IS 

deSi !rfoarticular upon starting method 200. step 203 is first perlormed. This step determines a gradient f'^hjot 
• ,r f-Thfe fe accomplished I by use of the so-called "Sobel" gradient operator on a w.ndow of p.xete centered about 
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GX(ij) and GY(ij), respectively, and for each pixel position <1,D forming the gradient strength, G(ij) as an absolute sum 
of GX(ij) and GY(i j): 

GX(i j) = L(k1 ♦ 2L(k1 j) + L(i+1.j+1) - L(M - 2L(M j) - L(M.j+1) (i) 
GY(ij) = L(i-1 j+1) + 2L(i j+1) + L(i+1 - L0-1 • 2L(i.j-1) - Lfi+1 j-1) (2) 
G(ij) = |GX(ij)|4|GY(i,D| (3) 

where: G(ij) is the gradient strength at pixel position 

(«J): ....... 

L(jj) is the image intensrty, luminance, at pixel 

The re^^g^radierrt strength value tor every image pixel collectively forms a gradient strength record tor the entire 

^"orrce^e gradient strength, G(ij), is determined for pixelfij). method 200 advances to step 206. This step, when 
performed determines the area gradient for pixel position (i j). i.e.. GS(i,j). as the sum of the gradient strengths for each 
and every pixel position within an (N-2)-by-(N-2) window centered about pixel position (i j). This window is illustratively 
5-by-5 pixels in size and is shown, as window 370. in FIG. 3C for an N-by-N. illustratively 7-by-7, window shown in FIG. 
3B the latter being window 330. centered about pixelfij). For purposes of comparison, the periphery of ah N-by-N 
window is shown as window 350 in FIG. 3C. Though shown sequentially to simplify illustration, step 245 is generally 
performed at essentially the same time, as symbolized by dashed line 244, as is steps 203 and 206. Step 244 determines 
both minimum and maximum pixel intensity values, and L^,. respectively, in an N-by-N window centered about 

P * e Once the area gradient is determined for pixel position (i j). then, through the remainder of method 200, the three 
image measures. GS(i.D and I™ and L^,. associated with this particular pixel position are used to classify pixelfi j) 
as an obiect pixel i.e.. back, or a background pixel, i.e.. white. 

In particular decision step 208 is performed to assess whether the value of the area gradient for pixel(i j). i.e.. GS(i j). 
exceeds a pre-defined threshold value, GT. or net. This test determines whether pixelfi j) lies in a vicinity dt an edge in 
the scanned image or not. If the area gradient is less than the threshold value. GT. then pixel(ij) does not lie near an 
edoe Hence pixelfi j) lies within a localized relatively constant tone. i.e.. Hat" field, region of the scanned-gray=scate— 
jmaoe In this case, method 200 advances along NOpath211 emanating from decision block 208 to decision block 21 5. 
This latter decision block determines whether the gray-scale intensity of pixelfij). i.e.. Uc. exceeds another pre-defined 
threshold value IT. If this gray-scale value is less than the threshold, the pixel is classified as an object pixel. i.e., here 
black- otherwise the pixel is classified as a background pixel, i.e.. here white. Specifically, on the one hand, if pixel 
intensity U is less than or equal to threshold IT, decision block 215 advances method 200, along NO path 217. to 
decision block 222 This latter decision block determines whether a user has previously instructed the method to produce 
a binary or gray-scale output pixel. If a binary pixel is desired, then decision block 222 advances the method, via YES 
oath 225 to block 228 which, in turn, sets an intensrty of output pixel(i j) to black, i.e., zero. Alternatively, if a gray-scale 
output is desired then decision block 222 advances method 200, via NO path 224. to block 230. This latter block, when 
performed sets the intensity of output pixel(i.j) to the intensity of Lc, without any modifications made thereto. It. on the 
other hand pixel intensity. I*. exceeds threshold IT. decision block 215 advances method 200, along YES path 218. to 
decision block 232 This latter decision block determines whether a user has previously instructed the method to produce 
a binary or grayscale output pixel. If a binary pixel is desired, then decision block 232 advances the method, via YES 
oath 235 to block 237 which, in turn, sets an intensity of output pixelfij) to white, i.e.. one. Alternatively. H a gray-scale 
output is desired then decision block 232 advances method 200, via NO path 234, to block 241 . This latter block, when 
performed sets the intensrty of output pixelfi j) to the intensrty of without any modrf ications made thereto. Once step 
228. 237 or 241 is performed, method 200 is completed tor pixelfi j); the method is then repeated for the next image 
pixel in succession, and so forth. . 

Alternatively if area gradient. GS(ij) exceeds the threshold value, GT. then pixel(i.D lies in the vicinity of an edge. 
In this case step 245 is now performed to ascertain the values of L^, and ^ if these values have not already been 
determined* as set forth above. Thereafter, method 200 advances to block 248 which calculates an average pixel intensrty 
value, lev . occurring within the N-by-N pixel window centered about pixel position (i.j). This average intensity value is 
simply determined by averaging the values Lma* and Lm\ n . 

Once this average value has been ascertained, method 200 advances to decision block 251 which compares the 
intensity of pixelfi j). i.e., against its associated average intensity value. L^g. When this pixel is situated on a darker 
side of an edge and hence an object pixel, then its associated average intensrty value will be greater than or equal to 
its intensrty value U. In this case, the output binary pixel for pixel position (i j) will be set to black. Otherwise, if pixelfi j) 
is situated near an edge but its average intensity value. L avg , would be less than its intensrty value, U. then this pixel is 
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increase thresholding accuracy. Hs associated average intensity value. 

,n particular. H gray-scale ^ ^J^S^^ 5S£hS£ todecision block 260. This latter decision block 
L then decision block 251 advances method 200. along NU ^^' bi or gray-scale output pixel. H a 

dTt£es whether a user P.'^^^^^ clock 268^.*. in turn, 

binary Pixel is desired, then decs on I ^ ^ g7 y - scale output isdesired. then decision block 260 

sets an intensity ot ^ ' b£*£i ^ latter block when performed, determines whether 
advances method 200. via NO path 262. to decision diock *#u. in . . , ^ ^, to th resh o!d 

pStensHy. U. «— » ,h,pr r25SS5S f ^^ni^S^ -tsthe grayscale output tor 
fr. then method 200 advances ^ l ^^^Jf23S«^ * e ^ 01 ,hresnoW ,X the " 

So 6 '^. ^ 56,5 * T ^ ^ P0<e,(l * to 8 

value\hat is slightly less. I.e ; , IT-, man h«h*rt associaled average intensity value. L^. thendecision block 

Alternatively. H gray-scalepixel .rrtensi* vk^ceeds ^ |aMef de ^ feion ^determines whether 
251 advances method 200. along YES path 253. to dec.^n btock 2 ™ y ^ ^ ^ „ a binary pbte , te desired, 
a user has previously instructed the methodic produce liana* « JJ^J^ set8 an intensity of output 

• then decision block 280 advances the method. T™ff|f!iIld^Sn decision block 280 advances method 200. 
pixel(ij) to white. i.e.. one. However rf ^^^^^^^^^ whether pixel intensity. U. is less 
via NO path 284. to decis.cn block 2« ^"J^J^J^o, fe equal to threshold IT, then method 200 
than pre-defined threshold value IT. r the irtensrty ^^^f^ tne g „ y<C a, e output tar pixel? j) to the pixel 
advances, along NO path 292 to block 295 which .^J^SddlT then method 200 advances; along YES path 
intensity value U- Now> « ,he "tens* p.xel( j) .s '«JJ"™ito riielllj) to a value that is slightly larger. La,. IT*. 
294.t7b.ock 297. which, when executes* h. > £^ tip-** threshotd IT is not critical 

r .-i^^rs^ ~ ^ KR« - <" *» ptee, ° a: m - d 200 fe 

men repeated for the next ^.^^S^^^^ depicts intensity profile 400 of an illustrative scan 
With this understanding ;n .Ml consderF G, •Jj*"*^^ 10 shown in FIG. 1 . As a result of processing 
,ine of an original gray-scale .mage.su* ^JJJJ^^JTboo. shown in FIG. 5. results. As is readily apparent 
p^ile 400 through , oun n**m ^^2KC25 the image pixels located near an edgeare modAjd 
from comparing profiles 400 ana ouu. a y u j while its intensity is larger than threshold 

in this regard, when such a fSSL ^ sttgMly less than threshold IT. Alternative*, when an image 

value IT. the intensity of this pixel l^^ 6 ^^^^ than threshold IT. the intensity of this pixel is 

PUe ' " ^va"^ >™* «- * threSh ° ,dinS *■ reSU,tinB 

Th/e^i^ 

As shown, circuit 600 is formed of line de ' a ^ ^ " 625 650 and 655; 7-by-7 Max and Min detector 635; 

9 radient detector 615; ^^^^^^^^ invert* 664. and gates 662. 670 and 
averaging circuit 640; multiplexors 680 and &w ana gaiing o. <~ discussed in detail above. 

S£o£h 600 collectively ^^nVJltST,^^^ leads 605 and 608. to an input ot 

,„ operation, eight-bit input gray-sca. ,mag ' p "*' 5( ' ^ ^ De ^ 610 . specHtoaOy series^nneoted single 
Hne delays 610 and to an oiput oT 7-by-7 Max and Mm, J^^.^ fpixel data centered around image pixel(u>. 
,ine delay elements 610, ™, «d6lO*P ^^^7S^Lpi fne of the window. The outputs of all three 
Each delay element is tapped at three locations o provide eacn i v calculation of the Sobel 

, d^lemUaremu^^ 

operator, as described above provides an j n - , sums g,, the gradient intensity values 

^dient value is applied to an input to ^^^^^^^rt sum. as an area gradient value, i.e.. 
in a 5-by-S window centered about p.xe pos. .on ^ ^^J^ in det8l , below. This area gradient value 

5 is applied to an input ( A > tothis same comparator. The resulting comparison output, appearing on 

the latter being applied to another inpu ^ * ed ge or not. The comparison output is applied as an 

!T elo. as discussed in detail below, the appropriate 
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Max and Miri detector 635. depicted in FIG. 8 and discussed in detail below, ascertains the maximum and minimum 
pixel intensity values, i.e.. and L^. of those pixels contained within a 7-by-7 window centered about pixelfi j). 
Resulting and L,™ values, appearing on leads 637 and 639. are then averaged by averaging circuit 640. This circuit 
contains summer 642. which merely adds these two values together into a resultant sum. and 12 and delay circuit 646 
which implements a divide by two operation by shifting the sum one-bit to the right; hence dropping the least significant 
bit The resultant averaged intensity value is then appropriately delayed within circuit 646 tor purposes ol achieving 
proper synchronization within circuit 600. 

If the area gradient value. GS(i j), exceeds the pre-defined gradient threshold. GT. then the averaged intensity value, 
L used as a threshold level in determining the value of output center pixel(i j); else, if the area gradient value is less 
than or equal to the gradient threshold, then value IT is used as the threshold level in determining the value of output 
center pixel(ij) In this regard, the averaged intensity value. L evg . is applied to one input of comparator 650. The current 
center pixel value. Lc is applied through delay element 630 to another input of comparator 650 as well as to one input 
of comparator 655. The delay of element 630 is set to assure that the proper corresponding values of Uc and L^g arc 
synchronously applied to collectively comparators 650 and 655, multiplexors 680 and 6S0, and gating circuit 660. The 
fixed threshold value. IT. is applied to another input of comparator 655. Comparator 650 produces a low or high or low 
level output on lead 653 if pixel intensity value is less than, or equal to or greater than, respectively, its associated 
averaged intensity value. Uvg- ™ s output level is applied to both one input p") of multiplexor 680 and one input of 
AND gate 662. Multiplexor 680 selects the output binary pixel as between two bits generated from using two different 
thresholds i e.. value IT or L evg . In that regard, comparator 655 produces a high output level at its A>B output whenever 
the predefined threshold value IT is greater than pixel intensity value 1^. The level at output A>B is routed, via leads 
657 to another input ("0") of multiplexor 680 and to one input of AND gate 670. Multiplexor 680 produces the output 
binary value for pixel(ij). To do so. the comparison output level produced by comparator 625, indicative of whether ths 
area gradient, GS(i,j). exceeds the gradient threshold. GT, is applied as a select signal, via lead 628, to a select CS°) 
input of multiplexor 680. If this select signal is high, thereby indicating that the area gradient exceeds the gradient thresh- 
old then multiplexor 680 routes the level applied to its "1" input, i.e.. that generated by comparator 650. to binary output 
lead 33* else, the multiplexor routes the level then appearing at its "0" input to lead 33. 

Multiplexor 690 routes the center pixel value. L^, or a pre-defined value IT+ or IT- as the output gray-scale value to 
eight-bit output leads 37. Pre-defined values n> and IT- along wrfo center pixel value Lc are applied to different corTe- 
soondina eight-bit inputs to multiplexor 690. The output of this multiplexor is determined by the state of two select signals, 
SO and Si: H these signals assume the binary values zero. "1" or -3*. then the multiplexor will route center pixel value 
■ ygi^ n+ or value IT-, respectively, to output leads 37. Gating circuit 660, in response to the comparison output 
sfonals produced by comparators 625. 650 and 655 generates, by simple combinatorial logic, the two select signals, SO 
and Si applied to multiplexor 6S0. Specifically, if the area gradient is not larger than the gradient threshold, then, ess 
discussed above gray-scale pixel value 1^, without any modification, will be applied through multiplexor 690, to output 
leads 37 Alternatively, if the area gradient exceeds the gradient threshold, then multiplexor 690 will apply ether value 
IT* or IT as a modified gray-scale output value to lead 37 based upon whether center pixel intensity value Uc is less 
than its corresponding average pixel intensity value. L^g. or not. Since the operation of gating circuit 660 is self-evident 
from the above description to anyone skilled in the art. it will not be discussed in any further detail. Values IT- and 
are merely held in appropriate registers (not shown) and from there applied to corresponding inputs of multiplexor 6S0. 

FIG 7 depicts a block diagram of Sum of Gradients Circuit 620 which forms part of circuit 600 shown in FIG. 6. 
Circuit 620 as shown in FIG. 7. is formed of adder 710 and line delays 720. the latter containing tour series-connected 
single-line delay elements 720 0 . 720,. 720 2 and 720 3 . Incoming gradient intensity values are applied, over lead 617 
from gradient detection circuit 615 (shown in FIG. 6), to one input of adder 710. shown in FIG. 7. In addition, the output 
of each of the four line delays 720 is routed over a different one of four feedback leads 715 to a different corresponding 
input of this adder. As a result adder 710 forms partial sums of 1-by-5 gradient values which are applied, as input, to 
delay element 720 0 . To generate a 5-by-5 sum of the intensity gradients, hence producing en area gradient measure, 
four preceding conesponding 1 -by-5 sums are added together within adder 71 0 to a present 1 -by-5 sum, with the result- 
ant overall 5-by-5 sum being applied to output lead 622. Use of these delay elements connected in this fashion substan- 
tially reduces the amount of logic that would otherwise be needed to generate twenty-five intermediate sums. 

FIG 8 depicts a block diagram of 7-by-7 Maximum and Minimum Detector 635 which also forms part of circuit 600 
shown in FIG. 6. As noted above, detector 635 determines the maximum and minimum pixel intensity values, L max and 
U, respectively within a 7-by-7 window centered about pixel posrtion(i.j). This detector is formed of two separate 
drcuits- maximum detecting circuit 805 and minimum detecting circuit 840 which extract a pixel value having a maximum 
and minimum intensity value, respectively, of all the pixels contained within the 7-by-7 window centered around pixelfl j) 
and respectively apply those two values to leads 637 and 639. Circuit 805 contains maximum detector 810 and line 
delays 820, the latter being formed of six series-connected single-line delay elements 820 0 . 820i. 820 2 . 820 3 . 820 4 and 
820 Similarly circuit 840 contains minimum detector 850 and line delays 860. the latter being formed of six series-, 
connected single-line delay elements 860 0 . 860 ^ 860 2t 860 3 , 860 4 and 860 6 . Inasmuch as circuits 805 and 840 function 
is an identical manner with the exception that detector 81 0 locates maximum values while detector 850 locates a minimum 
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. ~ ^Mromthesameseriestfpixeli^^ 

"The art wi.l then leadlly appreciate how circuit 840 functions from this disoissttn. 
those sMieo me ^ ma/|mum detector 810. In addrtion. the 

JESS-lT Slays £ *£2£L a drHerent one of six feedba* leads to a respective input , oMN. 
S?s2,uenJy maximum detector 810 extracts the maximum pixel intensrty value home 1 -by-7 senesotpoce 

?2^2Sr*£ ^ imum va,ue as ,o r,ne de,ay e,ement ,n con,unct, °" 8Ut prec ^^ 

values and applies in s n line delavs 820 maximum detector 810 locates the maximum pixel intensrty 

sponding maximum P>>e> va^s ^J^JJ L value, as output to leads 637. Here, the use of 

™L de 3 toMhieshokJs GT and IT. Threshold GT is set to properly classify image pixels located ,n the vranrty 
by the values defined tor ^ ° QT ^^^^ 

°I ^o'ixeTs ^ ht^r^^SntSTc. ie«s. In that regard, a low IT value tends to clas^r 

pixels of a uniform gray reg o ihr«Lldino with a fixed threshold IT. In this situation, the value of threshold GT 

purposes performs ^s.m.ar to Mention to classify pixefs by essentially solefy com- 

WH ' ££2 ^Lx e rofTn«er est * Q T^ threshold IT Our invention can also produce an outline image ^rpugh 
P T 9 TfJSm threshold IT to zero, in which case a., the image pixels will be dassHied as white except for the edge 
setting the va ue opiated area gradients are larger than the gradient threshold. GT. 

P0< LtTJoh Z S embodiment of the present invention has been shown and described ,n detar herein many 
ott^^ed e^mer^ that incorporate the teachings of the invention may be easily constructed by those skilled m 

the art 
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tv. indention is useful in image scanning systems and particularty tor thresholding scanned gray-scale 

The present invention .s us etu. in ge^ g y ^ ^ that pr^iousty 

;s e T^ «*• in •» ~— ima9e and substantiaDy 

eliminating boundary arlHacts from a threshold ed image. 



Claims 
1. 



2. 



so 



55 



* ,iws for ihresholdino an input gray-scale image into a first output image, wherein said irput image is formed 
A method g ^J^.^ g r ay. sca i e pixel value associated therewith, and wherein said first output image 

method comprises the steps of: _ an afea m ^ tor a f5rBt 

windov^uT^ KXradT^values associated wrth ones of the pixet vafues centered 

winaow to ui.u k _ n j ^ = pjxe , indices), in the input image; 

8bOUt "cS S in^Snseto: second w!ndow P (330). of pre-defined size, of input pixels centered ^about the 
cunem ptTpTsSn (ij^the input image, a maximum pixel value and a minimum pixel value of the pixel values 

contained within ^^^^^m value and the maximum and minimum pixel values, a current one of 

EE53£ SS^STSSJm * *• *>* *~ into an output «*- ^ 81 8 correspondinfl 

position in the f irst output image. 

_ „» 4K ^. „, ,|aim 1 wherein the area gradient ascertaining step comprises the steps of : 

^Sli^ilpSi to a third window (370). of the pixel values, of a pre-defined size and centered about 

* £Z52£*Zm the input image, an intensity gradient. G(i j). value for the cunent pixel position such 
Si X " Ts^eSion o, irSxrt pixels in the input image, a pturalrty of corresponding intensrty grad,ent values . 

"Storing the first window of intensity gradient values from the plurality of intensity gradient values and. in 
response to said first window, determining said area gradient value. 

. B mptnod in c iaim2 wherein said first window forming and area gradient determining step comprises the step of 
££Sm of the intensity gradient values in said first window to produce the area gradient value. 
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The method in claim 3 wherein said thresholding step comprises the steps of: 

comparing the area gradient value. GSfi j), to a pre-def ined gradient threshold value. GT. so as to produce 
a comparison signal indicative of whether a current one input pixel located at the current pixel position .(ij) in the 
inDut image lies in a vicinity of an edge in said input image; 

rf the comparison signal indicates that said current one input pixel does not Be m the vicinity of the edge, 
thresholding in response to said comparison signal, said input pixel value at position (i j) in the input image against 
a predefined fixed gray-scale threshold value. IT. to yield a corresponding binary output value at pixel position (i j) 

in the first output image; and . 

rt the comparison signal indicates that said one current input pixel does lie within me vicinity of an edge, 
setting in response to said conparison signal, said corresponding binary output value to a first or second state If 
the current one pixel value either exceeds or is less than an average of the maximum and minimum pixel values, 
respectively. 

The method in claims 3 or 4 wherein said intensity gradient measuring step comprises the step of producing the 
intensity gradient value for the current pixel position by processing said third window of input pixel values through 
a Sobel operator. 

The method in claim 5 wherein the third window is a 3-by-3 window of input pixel values end the Sobel operator 
implements the following equations: 

GX(ij) - MM j-1) + 2L(i+1 j) + L(i+1 j+1) - UMJ-1) - 2L0-1 j) - L(M j+1); 
GY(ij) - L(M + 2L(ij+1) + L<i+1 - L(i-1 j-1) - 2L(ij-1) - Lfl+1 j-1); 



and 



G(ij)-|GX(ij)l+|GY(i.fl| 



where: L(ij) is an input pixel value, in luminance, for 
the pixel position (ij) in the input image. 

The method in claim 4 further comprising the steps of: 

producing, in response to said conparison signal and the pixel value (Lc) at the current pixel position (i j). a 
modified gray-scale output pixel value at position (i j) in a second output image, wherein, rt the comparison signal 
indicates that the one current irput pixel does not lie in the vicinity of the edge in said input image, the modified 
orav-scale output pixel value is set equal to the pixel value Lc. or if the comparison signal indicates that the current 
one input pixel does lie in the vicinity of the edge, the modified gray-scale output pixel value is set equal to a pre- 
defined value greater than or less than the threshold value IT when the pixel value Lc is greater or less than, respec- 
tively the threshold value IT; and 

thresholding the modified gray-scale output pixel value, against the threshold value IT. to yield a corresponding 
second binary output pixel value at a pixel position (i j) within a second output image. 

Apparatus for thresholding an input gray-scale image into a first output image, wherein said input image is formed 
ofinput pixels each having a multi-bit gray-scale pixel value associated therewith, and wherein said first output image 
is formed of pixels each having a corresponding output pixel value associated therewith, characterized in that the 
apparatus utilizes the steps recited in any of claims 1-7. 
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